Papers by Hyuhng Joon Kim
When to Speak, When to Abstain: Contrastive Decoding with Abstention (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) demonstrate exceptional performance across diverse tasks by leveraging pre-trained (parametric) and external (contextual) knowledge. |
| Approach: | They propose a training-free decoding method that allows LLMs to generate responses when relevant knowledge is available and to abstain otherwise. |
| Outcome: | The proposed method can generate responses when relevant knowledge is available and abstain otherwise. |
Adaptive Contrastive Decoding in Retrieval-Augmented Generation for Handling Noisy Contexts (2024.findings-emnlp)
Copied to clipboard
Youna Kim, Hyuhng Joon Kim, Cheonbok Park, Choonghyun Park, Hyunsoo Cho, Junyeob Kim, Kang Min Yoo, Sang-goo Lee, Taeuk Kim
| Challenge: | Recent research has been developed to amplify contextual knowledge over parametric knowledge of large language models (LLMs) in knowledge-intensive tasks such as open-domain question-answering . |
| Approach: | They propose to amplify contextual knowledge over parametric knowledge of large language models (LLMs) by contrastive decoding to leverage contextual influence effectively. |
| Outcome: | The proposed approach improves open-domain question answering tasks especially in robustness by remaining undistracted by noisy contexts in retrieval-augmented generation. |
Aligning Language Models to Explicitly Handle Ambiguity (2024.emnlp-main)
Copied to clipboard
Hyuhng Joon Kim, Youna Kim, Cheonbok Park, Junyeob Kim, Choonghyun Park, Kang Min Yoo, Sang-goo Lee, Taeuk Kim
| Challenge: | Large language models (LLMs) are not specifically trained to deal with ambiguous utterances . ambiguity can lead to varying interpretations of the same input based on different assumptions or background knowledge . |
| Approach: | They propose a pipeline that aligns large language models to manage ambiguous queries . they propose to use their own assessment of perceived ambiguity to detect and manage queries a . |
| Outcome: | Experimental results show that APA empowers LLMs to detect and manage ambiguous queries while retaining the ability to answer clear questions. |
Ground-Truth Labels Matter: A Deeper Look into Input-Label Demonstrations (2022.emnlp-main)
Copied to clipboard
Kang Min Yoo, Junyeob Kim, Hyuhng Joon Kim, Hyunsoo Cho, Hwiyeol Jo, Sang-Woo Lee, Sang-goo Lee, Taeuk Kim
| Challenge: | Intuitively, ground-truth labels should have as much impact in in-context learning as supervised learning, but the impact of the quality of demonstrations remains elusive. |
| Approach: | They propose to measure input-label correspondence and ground-truth label effect ratio . they propose to use verbosity of prompt templates and language model size as controlling factors . |
| Outcome: | The proposed metrics show that ground-truth labels have less impact than previously thought . the authors identify key components as controlling factors to achieve noise-resilient ICL . |
Probing Out-of-Distribution Robustness of Language Models with Parameter-Efficient Transfer Learning (2023.starsem-1)
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) are gaining popularity on many benchmarks, but it is uncertain whether they can handle inputs that have been distributionally shifted. |
| Approach: | They evaluated various PETL techniques to detect out-of-distribution changes as the size of the PLM grows or the transfer methods are altered. |
| Outcome: | The proposed methods can detect out-of-distribution changes as the size of the PLM grows or the transfer methods are altered. |
A Dual-Layered Evaluation of Geopolitical and Cultural Bias in LLMs (2025.acl-srw)
Copied to clipboard
| Challenge: | Large language models exhibit cultural and geopolitical biases when their outputs shape public opinion or reinforce dominant narratives. |
| Approach: | They define two types of bias in large language models: model bias and inference bias through a two-phase evaluation. |
| Outcome: | The proposed framework evaluates large language models on factual and disputable questions across four languages and question types. |